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KAM theorem and the stability of planetary motions) which may be useful to both students and 
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I. INTRODUCTION 

At the beginning of the 20th century "mechanics had not yet lost its place as the central subject within physics, 
although it was on the verge of losing it" [T^. Fifty years later classical mechanics was considered, by the majority 
of physicists, a closed field from which one could not expect new challenges, specially in fundamental issues. But 
from then on, fresh mathematical results, together with additional numerical data obtained by high-speed computers, 
revived a field of knowledge related to non-linear dynamics and irregular behaviour of deterministic systems. A field 
that had begun at the end of the 19th century mainly by the works of Henri Poincare in his attempt to develop a 
convergent perturbation theory of planetary orbits. 

The solar system, despite its complexity, shows an extremely regular behaviour which can be predicted very ac- 
curately for short periods of time. This is due, in part, to the weakness of the gravitational force, but also because 
Kepler's two-body problem is completely integrable, despite the fact that any gravitational system of three or more 
bodies is not (let us imagine for a moment the difficulties of guessing the law of gravitation had the Earth been 
orbiting around a double star). The Newtonian deduction of Kepler's laws is based precisely on the properties of the 
integrable system of two bodies. Nevertheless, the dynamical interactions of the many bodies that form the solar 
system necessarily lead us to consider deviations to the predictions based on Kepler's laws. This makes us wonder: 
why does the solar system behave in such a regular way? Or, as in the inquiry of J. K. Moser: is the solar system 
stable? [2l] That is, will it follow in the future the order that we presently observe? Even today these questions do 
not have a complete and satisfactory answer. 

For more than three hundred years, since the time of Newton, the evolution and stability of mechanical systems, 
and specially that of the solar system, have been central to physics and mathematics. During the 18th century, Euler, 
Lagrange and Laplace made substantial developments by predicting changes in the planetary orbits due to small 
perturbations, establishing a framework for the study of global stability. All of this culminated in the 19th century 
works of Hamilton and Jacobi who reformulated the Lagrangian formalism of classical mechanics in terms of the phase 
space, a step which proved to be most fruitful for the developments of both statistical and quantum mechanics. 

These successes consolidated the idea of classical determinism. However, at the turn of the 19th century, the works 
of Poincare not only closed the door to an age but generated the first serious fracture in the philosophical conception of 
determinism. These works showed the impossibility of proving the convergence of perturbation series and, therefore, 
central questions, as the stability of the solar system, remained unanswered. Poincare was thus the first to study 
what much later has been called (apparently by J. Yorke in 1975) chaos. 

A plain, albeit not simplistic, definition of chaos is "chaos is the complicated temporal evolution of simple systems" 
[26| . Thus, and contrary to common thinking, chaos is not spatial and static disorder but a characteristic of certain 
motions. It is essentially a dynamical concept, in which two initially close trajectories may be divergent after a finite 
time. Chaos may appear in a variety of fields; physics, chemical reactions, the spread of illnesses, Internet, economics 



2 



and, of course, in planetary motions |26|. For contrary to intuition, chaotic behaviour is not an exclusive property of 
dissipative or random systems but of conservative and deterministic systems as well. 

Focusing on conservative systems we will show that small denominators giving place to resonances are associated 
to the appearance of chaos, and that due to this irregular behaviour, it seems impossible to predict the long-term 
evolution of nonintegrable systems (the vast majority of mechanical systems) using perturbation techniques. Since the 
end of the 19th century there was no remarkable advance and this fundamental question was practically forgotten until 
1954, when A. N. Kolmogorov gave a sketch of the proof that most trajectories of nonintegrable conservative systems 
are quasiperiodic and that one can obtain them through a convergent perturbation development. In the 1960's, V. I. 
Arnold and J. K. Moser gave a more formal and rigorous proof of this result, known as the Kolmogorov- Arnold-Moser 
(KAM) Theorem. 

In the coming sections we will explain and develop these ideas, stressing physical aspects, rather than mathematical 
concepts and technicalities, of which there are plenty in a field that was the starting point of modern mathematical 
developments such as topology. In this way the paper is intended as a comprehensive and intuitive introduction to 
deterministic chaos which, we hope, will be useful for either students and instructors. 



II. HAMILTONIAN MECHANICS 



The quintessential mechanical system, to which most physical systems are reduced, consists in a collection of mass 
points interacting between them. Experience shows that the state of the system is completely determined by the set 
of positions and velocities of all its particles. The reference system chosen to describe positions and velocities needs 
not be Cartesian. Thus, in the Lagrangian formulation of mechanics, the representation of the state of the system 
is obtained through generalized coordinates 91, . . . , (?„ and velocities gi, . . . , The minimum number of generalized 
coordinates needed to describe the state of the system is called the number of degrees of freedom. In what follows we 
will use bold letters to design vectors. Accordingly, the set of all positions is represented by the vector q = (gi, . . . , q„) 
and the set of all velocities by q = (gi, . . . , g„). 

The laws of mechanics are those that determine the motion of the system by providing the time evolution of the 
positions, q(t), and the velocities, q(i), of all its components. Therefore, the main problem is the determination of 
how the state of the system evolves with time. There have been several approaches to achieve this goal. The first one 
was based on Newton's laws which directly emanate from experience. This approach was subsequently refined and 
generalized by the Lagrangian and Hamiltonian formulations, being the latter the most appropriate for the present 
development. 

In the Hamiltonian formulation, the description of the state the system is also given by generalized coordinates 
q = (gi,...,q„) but instead of velocities by generalized momenta p — (pi,...,p„). The main problem is then 
finding the time evolution of these quantities, in other words, the knowledge of the functions q(t) and p(i) which give 
the temporal evolution of coordinates and momenta. This is achieved by solving the following set of In first-order 
differential equations known as Hamilton equations [U lll|, I18j : 



. dH . dH 

where the function H (q, p, t) is the Hamiltonian which, for inertial reference frames, coincides with the total energy 
of the system [6 . In ([T]) we have used the notation: 

dH _ fdH dH 
dq. \dqi'"'' dqn 

to denote the gradient of H with respect to q and analogously for dH/dp. 

For those readers not familiar with the Hamiltonian formulation, it may be useful to recall that for the three 
dimensional motion of a particle of mass m inside a conservative field of potential energy V(r), the energy (i.e., the 
Hamiltonian) is 



where q = r = (x, y, z) and p = p ■ p = + Py + pj,- In this case Hamilton equations (|1J) read 

P . dV 

m or 
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which coincide with Newton's second law. 

In the Hamihonian formulation, the state of a system with n degrees of freedom is described by a single point 
(q, p) = (qi, . . . , g„,pi, . . . ,p„) of a space of dimension 2n called phase space. Hence, starting at t = from an initial 
point (qo, po), the state of the system in a later time t will be given by the point (q {t) , p (i)), where q (t) and p (t) 
arc the equations of motion, that is, the solutions of Hamilton equations ([T]) with the initial conditions q (0) — qo and 
p (0) = Po- The trajectory described by the point (q(i),p(t)) as time progresses is called the phase-space trajectory 
of the system. 

One of the advantages of the Hamiltonian formulation is that we can evaluate the time evolution of any property 
of the system without having to know the form of the equations of motion. That is to say, without solving Hamilton 
equations which is usually quite involved. Let us assume that a given property of the system (for instance, the energy 
or the angular momentum) can be represented by a function, /(q, p, t), of the state of the system and the time. How 
does / change when the state (q(i),p(i)) evolves with time? The answer is simple and reads [TTl [T5] 



where [/, H] is the Poisson bracket defined by 



df dH df dH 



Observe that if / does not depend explicitly of time, df /dt = and / will be constant (i.e., df /dt — 0) if its Poisson 
bracket with the Hamiltonian vanishes: [/, H] = 0. In such a case /(q, p) is a constant of motion. Incidentally, for 
conservative systems the Hamiltonian is time independent, hence dH/dt = and, since [H,H] — 0, we see that H is 
a constant of motion, the energy. 

The Poisson bracket may be extended to any pair of dynamical functions /(q, p,i) and g(q, p,i). A direct gener- 
alization of ^ gives 

r. 1 ( df dg df dg\ 

From this definition one easily obtains a series of properties satisfied by the Poisson bracket. Properties that endow 
the set of dynamical functions with an algebraic structure called Lie algebra. We will not proceed here with this 
mathematical development and address the interested reader to specialized texts (see, for instance, pH]). 
For the special case that / and g are any of the g's or p's, definition Q gives 

[qi,qj] = [Pi,Pj] = 0, [qt,Pj] = S^j. (5) 

This is the condition for any set of variables (p,q) to be a canonical set, i.e., that they satisfy Hamilton equations 
with some Hamiltonian H ITj . 



A. Canonical transformations. The Hamilton-Jacobi equation 



Perhaps the greatest advantage of the Hamiltonian formulation is that it allows for transformations of variables 
preserving the form of Hamilton equations. There are several ways, all of them equivalent, to define these kind of 
transformations. We choose the following: 

We say that the change of variables, (q, p) (q',p')i given by the equations 

q = q(q',p',i) , p p(q',p',i) , (6) 

is a canonical transformation if the infinitesimal quantities p' • dq' ~ '^p'idq[ and p • dq — "^pidqi differ only in the 
total differential of a scalar function S: 

p' • dq' - p • dq ^ dS. (7) 

The function S is called the generating function of the canonical transformation. 

Observe that, because of ([6|, out of the four sets of variables: q, p, q' and p', involved in a canonical transformation, 
only two of them are actually independent. The generating function S will thus depend upon the two sets of variables 
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chosen to be independent, and also on t in the case of a time-dependent canonical transformation. One convenient 
choice, among others, consists in assuming that the generating function depends on the original coordinates and the 
transformed momenta, i.e, S — S{q,p',t). Combining this assumption with condition ([T]) one can easily show that 
the equations of the canonical transformation are given by [11] 

dS , dS 

It can be shown 118) that after a canonical transformation the Hamilton equations preserve the form: 

., dH' ., dH' 

where 

i/'(q',p',i) = i/(q,p,i) + ^, (10) 

is the transformed Hamiltonian. Note that for time-independent canonical transformations dS/dt — 0, and H' = H, so 
that the transformed Hamiltonian coincides with the original one (the latter being written in terms of the transformed 
variables) . 

Let us observe that any arbitrary function S generates some canonical transformation. This is quite remarkable, 
because it implies the freedom of writing Hamilton equations -that is, the laws of motion- in any convenient way only 
by the introduction of a given function S. 

Following this line of reasoning we might look for a canonical transformation such that the equations of motion 
would be the simplest ones. In other words, what would it be the generating function of the canonical transformation 
such that the transformed q's and p's are constants? Note that, if we could find this transformation, then we would 
have solved the problem of motion, for the equations of the transformation Q (or, equivalently, (|8])) give the equations 
of motion q(i) = q(Q:,/3,i) and p(t) = p(a,/3,i), where the new coordinates and momenta q' = a and p' = /3 are 
constants determined by the initial conditions. 

If the transformed variables are constant, their time derivatives are zero, and from ^ we see that dH'/dp' = 
dH' /dq' = 0. Accordingly, the transformed Hamiltonian H' must be independent of the coordinates and momenta 



and, at most, a function of time, which, for simplicity, we choose to be zero. Therefore, if in (10) we set H' = 0, 
and remembering that p = dS/dq (cf ([S])), we see that the generating function of the canonical transformation 
(q, p) — >■ {a,f3) obeys the equation 

H(^.f.,)^» (11) 



dt \ ' 9q' 

called the Hamilton- Jacobi equation. This is a first-order nonlinear partial differential equation and it provides an 
alternative procedure for finding the equations of motion [SJ 1111 118] . 



III. INTEGRABLE HAMILTONIANS 



In classical mechanics one of the most fundamental questions is the integrability of a given system. Here integrability 
does not mean whether or not the Hamilton equations can be solved in some particular way. In fact, as a set of 2n 
differential equations, they can always be solved (at least numerically) under very general conditions given by the 
Cauchy theorem p7|.[25] 

The concept of integrability refers to the existence of constants of motion (also called integrals and hence the name) 
which are responsible for the regular evolution of the phase-space trajectories of the system in well-defined regions 
of phase space. Due to its importance, let us recall again that a constant of motion is any function of positions and 
momenta which does not change with time whereas the g's and p's do. 

There are several equivalent definitions of integrability ^1, 23, 25, 27^, all of them underlying, in one way or another, 
the fact that Hamilton equations (or the Hamilton- Jacobi equation) are integrated in terms of as many constants of 
motion as degrees of freedom. One of these definitions, which turns out to be convenient for our purposes, is the 
following: 

The Hamiltonian of a system with n degrees of freedom is integrable if there exist n independent constants, 
or integrals of motion, (q, p) = ai (ai = constant, i — l,...,n), which are in "involution", meaning 
that the quantities li satisfy 



(12) 
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{i,j = 1,2, ... ,n) where is the Poisson bracket defined as in (|4|. 

Let us remark that the mere existence of n independent constants of motions is not sufficient for integrabihty; to 
ensure that any system is integrable it is also necessary that the constants of motion satisfy the property of involution 



(12). Property that guarantees the existence of a canonical transformation for which the transformed momenta are 
precisely the integrals of motion = li and, therefore, constants. For constant momenta the integration of Hamilton 
equations is immediate. This is essentially the content of a theorem attributed to Liouville [27] and what ultimately 
justifies the above definition of integrabihty (see |A] for a more complete discussion). 

Unfortunately, the existence of n integrals of motion in involution is the exception more than the rule. Poincare 
proved, more than a century ago, that most mechanical systems only have the energy as a constant of motion. 
Therefore, most systems with more than one degree of freedom are not integrable. 

A paradigmatic example is provided by a closed A^-body system, i.e., a set of N point particles interacting with 
each other without external forces acting on them. [29, The N body system has 3A^ degrees of freedom (3 for each 
particle) and only 10 integrals of motion. These are: 



• The three components of the total momentum 

N 



P = pk = constant. 



k=l 

• The three components of the motion of the center of mass (M is the total mass of the system) 

R-CM(i) —Pt = constant. 

• The three components of the total angular momentum 

N 

L = Ik — RcM X P + 1 = constant, 

/c=l 

where 1 is the relative angular momentum. 

• The energy 

E = — P^ + Trel + V ^ constant. 
2M 

where Trei is the relative kinetic energy and V is the potential energy. 

From these ten integrals only six of them are independent and in involution: the three components of the total mo- 
mentum P, the square of the relative angular momentum the third component of the relative angular momentum 
Z3 , and the total relative energy T^ei + V [21] . 

When N — 2, the two-body problem, there are 6 degrees of freedom and the problem is integrable. However, when 
= 3, the three-body problem, there are 9 degrees of freedom but only 6 independent constants of motion in involution; 
whence, the three-body problem (for example, the system Sun-Earth-Moon) is not integrable. 



A. Invariant tori 



Let us first focus on integrable systems and postpone nonintegrable systems for later sections. A first and most 
important consequence of the existence of n involution constants li is that the trajectories of the system cannot 
pass through all points of the phase space. This is due to the fact that all trajectories are confined to move in a n 
dimensional manifold M determined by the constants of motion and embedded in the phase space of dimension 2n. 
Indeed, the manifold M is defined by the set of n algebraic equations: 

-^i(q,p) = ai •■• ^(q,p)=an, (13) 

where ai, • • • a„ are arbitrary constants. Consequently, the phase-space trajectories never leave M because otherwise 
the conservation laws would be violated. Note that the manifold M depends on the particular value of the constants 



(a) (b) 

FIG. 1: The "hairy baU theorem", (a) Vector fields smoothly "combed" on a 2 dimensional torus, (b) Singular point of a 
vector field on a 2 dimensional sphere. 



of motion and, since the latter depend on the choice of the initial state of the system, we see that M is fixed by the 
initial conditions. 

In what follows we will assume that the motion of the system is bounded (recall, for instance, the planetary motion). 
As a consequence of this, the manifold M must be bounded as well. In fact, it can be shown, that M is a compact 
(closed and bounded) manifold j23j . We will now see that in this case M has the topology of a n dimensional torus. 

In effect, let us define the following n velocity fields: 



9p ' dqj 



(14) 



{i — 1,2, ...,n). Note that if, for example, Ii = H then (cf (|lj)) vi = (q, p). Accordingly, in (14) is included the 
Hamiltonian flux of the phase-space trajectories which, due to the existence of n independent integrals in involution, 
must be completely contained in the manifold M. 

In order to visualize that M has the topology of an n dimensional torus, let us first show that the fields 
(i = l,2,...,n) are independent and tangent to M. The property of independence immediately follows from the 
independence of the integrals Ii. We next observe that the 2n dimensional gradients: 



dl^dl^ 
dq ' dp 



(j — 1, . . . , n), are orthogonal to every surface Ij{p, q) — aj. 

On the other hand, the scalar product of the fields with these gradients is 



^ dp dq dq dp ^ \^ dqk dpk dpk dqu j 
and, by virtue of the involution property, we get 

v,.V/j = =0 

(i, j = 1,2,..., n). Hence, the fields are orthogonal to V/j and, since the gradients V/j are orthogonal to M, we 
conclude that the fields are tangent to the manifold M . 

There is a theorem in topology -the Poincare-Hopf theorem, jokingly known as the "hairy ball theorem"- which 
states that if in a compact manifold M of dimension n, one can define n independent vector fields tangent to M , then 
M has necessarily the topology of an n dimensional torus [21 [23l [25] . 

Without getting into technical details, we can intuitively imagine this result as follows. Among the several possibil- 
ities for a manifold M to be compact, and hence bounded, the simplest ones are: either M is a n dimensional sphere 
(or a surface with the same topology, like an apple) or it has the topology of an n dimensional torus. However, it 
is impossible to define a vector field on a sphere in all its points while it is perfectly possible to define a vector field 
on the surface of a torus. This is easily visualized if we compare the act of combing down hair on a torus and on a 
sphere -for the latter case, a hair always sticks up at the pole and, hence, it is not tangent to the sphere- see Fig. [ij 



FIG. 2: The two topological independent curves Fi and F2 on a 2 dimensional torus. 



IV. ACTION-ANGLE VARIABLES 



We have just seen that, for the bounded motion of integrable systems with n degrees of freedom, the phase-space 
trajectories he on n dimensional tori embedded in the 2n dimensional phase space. We will now see that the existence 
of these invariant tori'30] provides a way of defining a new set of canonical variables, the action-angle variables, which 
are crucial for the further development of the subject. 

Indeed, any n dimensional torus is a periodic object which can be considered as the product of n independent 
periodicities. In other words, we can define n topologically independent closed curves, Fi, . . . ,r„, on a given torus, 
where none of the F^ can be deformed continuously into each other or shrunk to zero [231 [22] • In Fig- [2] we represent 
a 2 dimensional torus for which Fi turns around through the longest path while F2 does it through the shortest path. 
Note that, neither Fi nor F2 can be converted into each other by continuous transformations. 

Having this set of closed curves at our disposal, we define the action variables by means of the line integrals: 



(15) 



where 



Pk = Pk (q, a) 



(16) 



are the momenta written in terms of the coordinates q = (qi, . . . , g^) and the constants of motion a = (ai, . . . , Q!„). 



Notice that ( 16 ) is obtained by solving for the p's the set of algebraic equations ( 13 1 provided by the existence of n 



independent integrals. 

Since in (15) we integrate with respect to the generalized coordinates, the action variables only depend on the 



integral invariants: 



Ji = Ji (ai, . . . ,a„) 



(17) 



(i = 1, . . . , n), and are themselves constants of motion. 

We now define a canonical transformation from the original variables (q, p) to a new set of variables (0, J) where 
the actions are the transformed momenta. A generating function for this transformation is given by the indefinite 
integral 



/n 
^Pfc(q, J)dgfc, 
k=l 



(18) 



where pfc(q, J) is given by (16) in which the a's have been written in terms of the J's after solving (17) 



We shall see below that the new coordinates, defined by 

e 



(19) 



play the role of angles, increasing by 27r when the phase-space trajectory undergoes a complete turn around F^, while 
momenta (i.e. the actions) are the radii of the invariant tori (see Fig. 



FIG. 3: Nested tori for several values of the actions in two degrees of freedom. The vectors J — (Ji, J2), J' — (Ji, J2) and 
J" — {J" , J'2') label the different tori and correspond to different initial conditions. {9i, 62) are the angle coordinates on a given 
torus. 



In action-angle variables, Hamilton equations read 

where H' = H is the transformed Hamiltonian which coincides with the original one since we are dealing with a time 
independent canonical transformation. 

However, J = 0, because the J's are constants of motion. Hence, dH' /dO — 0, and the transformed Hamiltonian 
only depends on the actions: 

H'=H{3), 

whence 

6 = ^^J-"^^ =u}(J) = constant. (21) 
oJ 



The solution of the Hamilton equations ( 20 ) thus reads 



Ji = constant, 9i{t) = Uit + jSi, (22) 

where Pi = di{0) (i = 1, . . . , n). 

In action-angle variables, the equations of motion are, therefore, very simple: the actions (transformed momenta) 
are constants and the angle variables (transformed coordinates) are linear functions of time. In the original variables. 



(q, p), the equations of motion are obtained by introducing (22 1 into the equations of the canonical transformation 
(QiP) — ^ J) which gives the original variables in terms of action-angle variables. 

Before proceeding further let us note that the transformation to action-angle variables is global. That is, the entire 
phase space is filled with tori (see Fig. ^ and a given trajectory will forever reside on the surface of the particular 
torus fixed by the initial conditions (q(0j7p(0)). Indeed, the choice of any invariant torus depends on the value of the 
constants = /i(q(0), p(0)). The set of constants ai determines the torus where the trajectory stays and the value 
of the angle variable 9i, at a given time, determines the position of the trajectory on that torus. 

We will see next that the uj 's are the angular frequencies of the multiply periodic motion of the system. To this 
end we first show that when the state of the system performs a complete oscillation along a closed curve Ti, the 
corresponding angle variable varies in 2tt. In effect, let us denote by Ai0j the change of the angle variable 9j when 
the coordinate qi realizes a complete oscillation (also known by the astronomical name of "libration" ) . In the [b] we 
show that 

A.Oj = 2nSij. (23) 



In other words, the angle variable 0i changes in 27r only when the system executes a complete oscillation along the 
curve Ti and no change otherwise. 



9 



On the other hand, let Ti (z = 1, 
the change in 9i after a period Ti is 



and equating it with ( 23 ) we get 



,n) be the different periods of each hbration motion. We see from (22 1 that 



T = 



27r 



Therefore, the quantities uji -defined in (21) as derivatives of the Hamiltonian with respect to the actions- are 



the angular frequencies of the (multiperiodic) motion of the system. This is quite remarkable since, for integrable 
Hamiltonians described by action-angle variables, to obtain the frequencies of the motion it is not necessary to 
integrate Hamilton equations, it suffices to take the derivative of the Hamiltonian with respect to the actions, a much 
easier task indeed. 



A. Periodic and multiply periodic motion 



Recall that the original variables, (q, p), and the action-angle variables, (0, J), are related by a canonical transfor- 
mation with the generating function ( 18 ). This obviously implies that the relation between these two sets of canonical 
variables is known. Let us denote this relation by 

q = q(0,J), p = p(0,J). (24) 



Owing to the periodic nature of the angle variables, as expressed in equation (23), we see from (24 1 that the g's and 
p's are multiply periodic functions of the 0's with periods 27r, and the same is true for any dynamical function J). 

As is well known from analysis, any multiply periodic function can be represented by a multiple Fourier series. 
Thus, for instance, qj would appear as 



ici 



fcl— — OO kn — — O0 



where the fc^'s are integer indices running from — oo to oo. By treating the set of fc^'s also as an n dimensional vector, 
k ~ (fci, . . . , A;„), the expansion can be written in a more compact form: 



where we use the abbreviated notation: 



The Fourier coefficients which depend on the actions, are given by 



E= E ••• E 

k A,'i— — oo kn — — o 



{2nY 



Jo Jo 



If we also write the time dependence of the angle variables -given in ( 22 )- as a vector equation, 
then the time dependence of Qj appears in the form 

k 

where a'^^ — c^^ e''^'^ . We easily convince ourselves that a similar expression holds for any momentum: 



f.W^E^k (J)e 



(25) 



(26) 



Notice that the right hand side of equations ( 25 ) and ( 26 ) correspond to a superposition of the equations of motion 
of n linear oscillators. Therefore, 
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(a) (b) 

FIG. 4: Comparison of phase-space trajectories on 2 dimensional tori. The torus in (a) is a rational surface (resonant torus) 
where u}i/u)2 = 3, that is, the trajectory closes over itself after three turns around Fi and one turn around F2. The torus in (b) 
is an irrational surface (nonresonant torus) where the frequencies are not commensurable. In (b) the phase-space trajectory 
will eventually cover the surface of the torus densely. 



the coordinates and momenta of integrahle systems can he represented as a sum of n dimensional harmonic 
oscillators with angular frequencies given by the fundamental ones, a; = (wi, . . . ,Cli„), and their harmonics 
k • a; = kiLUi + • • • + A:„aj„, (kj — 0, ±1, ±2, • • •). 

The coordinates and momenta of integrable systems are multiply periodic functions of time with n independent 
(angular) frequencies wi, . . . However, this property does not imply that, in general, the q's and p's are (simply) 
periodic functions of time; for it would be necessary that there exist a single period Tq for which all q's and p's are 
periodic: 

q(i + To)=q(t) and p(t + To) = p(t). 

In the [C] we show that this is the case if, and only if, the frequencies wi , . . . , aj„ are integer multiples of a single 
frequency uiq: 

ujj = IjUjQ, (27) 

(j = 1, . . . , n), where Ij = 0, ±1, ±2, • • • are integer numbers, and 

27r 
Jo 



Equation (27 1 means that in order to have periodic motion, the frequencies must be commensurable. From (27 1 we 
immediately see that this is equivalent to assuming that all frequencies are rational multiples of each other 

— — — a. rational number. (28) 

If the frequencies are incommensurable, in other words, if they are not rationally related, then the motion is termed 
multiply periodic or quasiperiodic or conditionally periodic, according to different terminologies in use, and never 
repeats itself. 

A formal condition for the frequencies to be commensurable is the existence of n — 1 relations of the form 

n 

Y,h,uj,^0, (fc = l,...,n-l), (29) 



where Ik^ = 0±1±2±-- - are integers. Indeed, if ( 29 1 holds, then we have an homogeneous system of n — 1 algebraic 
equations (with integer coefficients) for n unknowns, the frequencies, which means that we can solve (29) by writing 
all frequencies in terms of one of them, say uji. In other words, we obtain Uj — {mj/mi)uji, where mi and ruj are 
integers. Therefore, coj/uJi = rrij/mi is a rational number, and all frequencies are commensurable. 

Let us remember that the phase-space trajectories lie on the invariant tori defined by equation (22 1, and since 
these curves are mathematically described by functions of coordinates and momenta, the above considerations on 
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single or multiple periodicity apply to phase-space trajectories as well. We can, therefore, conclude that on a given 
torus, the phase-space trajectory will he a closed curve (i.e. the motion of the system will be periodic) if and only if 
the frequencies of the motion are commensurable. When frequencies are incommensurable the trajectory will densely 
cover the torus, never closing on itself. In the first case, we call it rational, or resonant, torus, while in the latter 
irrational, or nonresonant, torus (Fig. |4]). 



B. The Kepler problem 

A classic example of an integrable Hamiltonian is provided by the Kepler problem. Consider the relative motion of 
a planet of mass m orbiting around a star of mass M . The Hamiltonian of the system in polar coordinates, (r, (f)), is 

where {pr,P4>) is the relative momentum of the two bodies, fi = mM/ (m + M) is the reduced mass and k ~ GmM 
{G is the gravitational constant). 

Both the energy, Hq — E, and the angular momentum, L, of the two-body system are constants of the motion. 
The latter implies that the motion takes place on the plane perpendicular to the direction of L. 

After a canonical transformation from the original variables {pr,p,p, r, 0) to the action-angle variables (Ji, J2, Oi, ^2), 
the Hamiltonian is only a function of the actions [TTJ [TH] : 

Ho= „.r^^' 2 - (31) 



2 [Ji + J, 



2 



The equations of motion in the original variables are quite complicated (elliptic orbits) , but in terms of action-angle 
variables they are very simple: 

J, =a,, 9,{t)=Lo,t + p„ (32) 

(i — 1,2) where and l3i are constants determined by the initial conditions. 

The motion of the system in the phase space (i.e., the phase-space trajectory) lies on a two dimensional torus 
embedded in the three dimensional manifold of constant energy. The torus has two angular coordinates 9i and 62 
and two constant radii Ji = ai and J2 = a2 which are fixed by the initial conditions. 

There are two frequencies, uJi and ll)2, associated to the motion; If they are commensurable, that is if huji = Z2W2, 
where li and I2 are integers, the trajectory is closed and the motion is periodic (the trajectory closes on itself after 
li turns around Fi and I2 turns around F2). If the frequencies are incommensurable the trajectory will never repeat 
itself and will eventually cover the entire surface of the torus. 

For the Kepler problem the frequencies are (recall that uJt = 9i = dHo/dJi) 

which is Kepler's third law. The frequencies are commensurable (in fact, equal) and hence the phase-space trajectory 
is always closed. In other words, the motion is periodic. 




V. NONINTEGRABLE HAMILTONIANS. 



We know that the existence of as many constants of motion in involution as degrees of freedom determines inte- 
grability and regular motion. On the other hand, conservative systems with one degree of freedom always have one 
integral of motion, the energy, and they are, therefore, integrable. The following question then suggests itself: can 
we know whether or not a conservative system with n > 1 degrees of freedom is integrable? Unfortunately there is 
no general answer to this problem. In most situations, integrability is guessed, but not proved, by constructing a 
Poincare surface of section which we can define as any bidimensional surface, contained in the phase space, where 
one can conveniently analyze the successive intersections of the phase-space trajectory (Fig. [s]). 

To see how this concept works, let us suppose a conservative system with two degrees of freedom. The Hamiltonian 
is a constant of motion and we write: 



H{qi,q2;Pi,P2) = E. 



(33) 
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FIG. 5: Intersections of a phase-space trajectory with a Poincare surface of section. 




FIG. 6: Construction of a Poincare surface of section for a system with two degrees of freedom, (a) We can obtain a Poincare 
section plotting a point each time q2 = 0, i.e., each time the trajectory passes through the plane (51, pi). (b) If there are 
two integrals of motion in involution, the trajectory will remain along one dimensional curves, pi = 4>{q\, 0; E, a), in the plane 
(gijPi). (c) If only one constant of motion exists (the energy), the trajectory will disperse over a region of the (gi,pi) plane. 



This restricts phase-space trajectories to evolve inside a 3 dimensional manifold -the surface of constant energy or 
"energy shell" represented by (33 1- embedded in the phase space which has dimension 4. Suppose the system has a 



second integral (for instance, the angular momentum): 

^(9i,92;Pi,P2) 



a, 



(34) 



where a is an arbitrary constant; then this integral also defines another 3 dimensional manifold in the 4 dimensional 
phase space and any trajectory must also evolve in it. 

The coordinates and momenta of the system cannot take arbitrary values because they must satisfy the conservation 
laws (33 1 and (34). From a geometrical point of view, this means that any phase-space trajectory is bounded to move 
on a 2 dimensional surface which is the intersection of two 3 dimensional manifolds H — E and I — a. Indeed, from 



the conservation of energy (33), we can write, for instance, p2 as a function of pi,qi,q2 and the energy E, that is, 
P2 = P2(9ij Q2tPi] E). Substituting this expression into the second conservation law (34) we can obtain pi in terms of 
qi and q2 and the constants E and a: 



(35) 



This is the equation of a 2 dimensional surface within the 4 dimensional phase space. Such a surface is determined 
by the specific values of the constants E and a, which, in turn, depend on the initial conditions. 

If we now consider the section 52 = of the surface ( 35 1 -and this is an example of a Poincare surface of section- 



we see that the successive intersections of the phase-space trajectory with this Poincare section are along the curve 

Pi = <l){qi,0;E,a) 



on the plane (qi,pi). 
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FIG. 8: Poincare section for the Henon-Heiles Hamiltonian at high energy E = 0.12. 

In general, for a given conservative Hamiltonian, we do not know whether or not a second integral of motion exists. 
We can guess, nonetheless, its existence by solving Hamilton equations numerically and then drawing pi and qi each 
time q2 = (Fig. [6] (a)). If the system is integrable, the intersections of the trajectory in the Poincare section q2 — 
will appear as a collection of points regularly distributed on the curve pi = (j) (91, 0; E, a) (Fig. [6] (b)). On the other 
hand, if the system is not integrable the intersections of the phase-space trajectory will appear randomly -that is, 
chaotically- scattered over a region only limited by the conservation of energy (Fig. [6](c)). 

This was the method used by Henon and Heiles [TS] to determine the possible existence of a third integral which, as 
the observations showed, constrained the motion of a star in a galaxy with an axis of symmetry. This system has three 
degrees of freedom and two known constants of motion, the energy and the component of the angular momentum 
along the direction of the symmetry axis. For a long time it was believed that there was no third integral of motion 
because it had not been found analytically. 

Henon and Heiles proposed the following Hamiltonian -without any known symmetries leading to a third integral- 
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that could model the basic traits of the problem [TSl US] : 

and numerically studied the behaviour of the equations of motion. The Hamilton equations are 

(it = Pt, Pi = -qi - 2gig2, P2 = -q2 - 2qf - 2ql, 

(i — 1,2). Observe the occurrence of non-linear quadratic terms in these equations of motion which are consequence 
of the cubic terms in the potential energy. Note also that the magnitude of these non-linear terms increases with 
the energy. The representation of the intersections of the phase-space trajectory on the Poincare section 52 = is 
given in Figs. 7][8 For low energies (Fig. [7|, the distribution of points is apparently regular, which seems to suggest 



the existence of a third integral, at least to the accuracy of the plotting. As the energy increases (which increases 
the effect of the nonlinear terms) the third integral appears to be destroyed, at least partially, but still remain some 
"islands" where the motion is regular (Fig. [8|. For even higher energies the hypothetical third integral is completely 
destroyed. The scattered points appearing in Fig. |8] correspond to a single phase-space trajectory that, for obvious 
reasons, we will call chaotic, and which implies a highly sensitive dependence on initial conditions that makes the 
long-time evolution of the system totally unpredictable. 



VI. CANONICAL PERTURBATION THEORY. RESONANCES 



As stated in previous sections, most mechanical systems are not integrable, having only the energy as a constant 
of motion. However, in many situations, integrable and nonintegrable Hamiltonians differ very little. In such cases 
we can obtain approximate solutions of the equations of motion by means of the canonical perturbation theory. We 
will outline this theory because it provides the clue to the appearance of chaos in deterministic systems, for it shows 
that chaotic behaviour is a direct consequence of the occurrence of resonances, i.e., of small denominators leading to 
infinities. 

In order to fix ideas, let us return to the Kepler problem discussed in section [IV B| and suppose that, in addition to 
the planet orbiting the Sun, there is another celestial body which perturbs the motion of the two-body system. We 
assume that the effect of this perturbation is small (because, for instance, the third body is small or more distant), 
so that the total Hamiltonian can be written in the form 



H^Ho (Ji, J2) + eHi ( Ji, J2, 01, 02) , 



(36) 



where e ^ 1 is a small parameter and Hq is the unperturbed Hamiltonian of the Kepler problem as given in (31 ). 

According to our previous discussions, we know that the unperturbed motion, represented by Hq, takes place on 
a bidimensional torus of radii = a^, (z = 1, 2). We want now to find the corrections to the unperturbed motion 
due to the presence of a third body. As we generally cannot obtain an exact solution to the equations of motion, we 
search for approximations via perturbation expansions in powers of e. 



Observe that the motion generated by the Hamiltonian (36) is bounded. This allows us to expand the perturbation 



as a Fourier series in the angular variables. Therefore, following the notation of section IV A we see that (36) can be 
written as 



Hie,3)=Ho{3) 



e^H«(J)cos(k.0), 

k 



(37) 



where = (0i, . . . , 0„), J — (Ji, . . . , J„) and k = (fci, . . . , fc„) (fc^ = 0, ±1, ±2, • • •). The Fourier coefficients, hI^\3), 
are defined by 



^k'^(J) = / d0i-- - [ dOn i/i(J, 9) cos (k • 0) . 

(^"■J Jo Jo 



(38) 



Let us note that we have generalized ( 36 ) to include multiply periodic systems with n degrees of freedom. 



The main idea behind canonical perturbation theory is simple and consists in finding, by means of a power series 
in e, a canonical transformation. 



{9,3) (0',J'), 



(39) 
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to a new set of action-angle variables such that the transformed Hamiltonian H'{3') is only a function of the new 



actions J'. If we could achieve this, then the Hamiltonian (36 1 would become completely integrable and its equations 
of motion would be easily obtained; that is, the J"s would be constants and the 0"s linear functions of time. 

Unfortunately, this procedure cannot be done exactly. However, we may proceed by perturbation expansions since 



e is small. We take this path and introduce the following generating function for the canonical transformation ( 39 ) 



S{9, J') = 9-J' + eJ2 Ski^') sin (k • 6>) + O(e^), (40) 

k 

which is defined by a perturbation series up to first order in e with the unknown Fourier coefficients S'k(J') to be 
determined later. In terms of the generating function, the canonical transformation is obtained by (cf ([s])) 

dS dS_ 
dO' 83'- 

That is 

J = J' + e ^ k5'k(J') cos (k • 0) + 0{e^), (41) 



k 



(42) 



Since we are dealing with a time-independent canonical transformation, the transformed Hamiltonian, H' ~ H, 
coincides with the original one. Therefore, the new Hamiltonian is found from (37) by solving the equations (41) and 
(42 1 for {6, J) as a function of {0',3'). We detail this procedure in the [P] where we show that 



H'{e',3') = ffo(J')+e^o'^(J') 

[ir^'^(J')+k-a;5k(J')] cos(k-6/) + 0(e 



k^^O 



In this expressions u; = i-o{3') are the (known) frequencies of the unperturbed motion: 



whereas hIj^\3') is the Fourier coefficient of the perturbation corresponding to k = and reads (see (38)) 



{2n) 



d0i 



(43) 



(44) 



(45) 



In other words, is the average of the perturbation Hi with respect to the original angle variables. 

Recall that the Fourier coefficients S'k(J') of the generating function (40) are still unknown and we are, therefore, 
free to choose them in the most convenient way. Let us take 



5k (J') 



hL'\3') ^ 



(k 7^ 0), so that the term inside the sum in equation (431 vanishes; we get 

H' ^Hoi3')+eH^'\3') + 0{e') 



(46) 



(47) 



In such a case, and to the first order in e, the transformed Hamiltonian H' is only a function of the new action 
variables and is, therefore, integrable (up to first order). 

Moreover, the perturbed frequencies u)' (given by the derivatives of the transformed Hamiltonian H' with respect 
to the actions) read 



i^'=u; + e^H^,'\3') + 0(e'), 



(48) 
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where H^\3') is the average of the perturbation Hi (cf (46)) and u) are the unperturbed frequencies given by (44) 
Finally, the relation between the original actions and the new variables, is given by (see (41) and (42|) 



J = J' e ^ k 



k • (jj 



cos (k ■e') + (e^ 



(49) 



Equation (49) is, to the lowest order in e, the solution to our problem. We have obtained the new action variables J' 



which contain the first-order correction due to the perturbation. To first order in e the J' are constants and the new 
angles 6' linear functions of time. 



Unfortunately, the expressions (46) and (49 1 suffer a serious illness, for both S'k and J diverge if 



kiUJi 



0. 



(50) 



In other words, the perturbation method breaks down when internal resonances occur inducing perturbation expansions 
to diverge. 

Let us observe that if the unperturbed motion takes place on a rational (resonant) torus, i.e., if the frequencies of 



the unperturbed Hamiltonian Hq are commensurable, there always exists a set of integers such that condition ( 50 ) 
holds (see (|29|)). At first sight, this would imply the restriction of canonical perturbations to the motion on irrational 
(nonresonant) tori. However, the problem is worse, because, even if the frequencies are incommensurable (and recalling 
that any irrational number can be approximated, within any degree of accuracy, by a sequence of rational numbers) 
there will always be integers ki,...,kn that generate denominators k • w as small as desired, with the result of 
convergence failure. |3Tj Hence we get two series whose convergence is uncertain. For one hand, we have Fourier series 
that cannot converge due to internal resonances which lead to the famous problem of "small denominators" . On the 
other hand, far from resonant frequencies and also because of small divisors, it is quite unclear that the perturbation 
series in e converge. In fact, Poincare proved that all these series do not lead to a convergent representation of the 
perturbed problem |27j . Consequently, fundamental questions, as the long-time stability of planetary orbits in the 
solar system, could not be answered in a satisfactory way. Let us remind Moser's query and ask again: Is the solar 
system stable? 



VII. THE KAM THEOREM. STABILITY AND CHAOS 



At the end of the 19th century, the general consensus was that the addition of even the smallest perturbation would 
render any conservative system nonintegrable, and that any phase-space trajectory would densely explore the energy 
shell in a chaotic manner. [32j This was the first crack in classical certainty and a severe blow on classical thinking. 

All efforts and attempts by some of the finest mathematicians and physicists of the time failed to solve the small 
divisor problem. Poincare called it the "fundamental problem of classical mechanics" and seemed to be an unsur- 
mountable obstacle. Thus, around the beginning of the 20th century, this field of research dropped off and questions 
concerning long-time planetary stability were almost forgotten in mainstream research. 

The breakthrough came in 1954, when A. N. Kolmogorov [T7] devised a way of obtaining a theory of canonical 
perturbations which is rapidly convergent and appropriate to nonresonant tori. Kolmogorov's new idea was rigorously 
proved by V. I. Arnold in 1961 [T] and, independently, by J. K. Moser in 1962 [20] ■ The complete result is known as 
the Kolmogorov- Arnold-Moser (KAM) Theorem. 

Following Arnold ( [1112] , see also [IS] ) suppose that an integrable Hamiltonian Hq is perturbed by a function Hi , 
so that the total Hamiltonian is 

H = Ho (J) + eHi (J, 6) , (51) 
(e <^ 1) where the perturbation Hi is assumed to be periodic in the angular variables: 

Hi{J,ei + 27r,...,0^ + 27r)^Hi{J,9i,...,0^). 

Hamilton equations read 

(i — 1,2, . . . ,n) where tUi = dH^/dJi are the frequencies of the unperturbed motion. 

Kolmogorov's idea was that, far from resonant frequencies, it is possible to construct a perturbation series in even 
powers of e. This leads to a fast convergent ( "superconvergent" ) perturbation series with the overall result that, for 
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most initial conditions, the motion generated by the Hamihonian (51) remains quasiperiodic, that is, confined to 
reside on certain surfaces which resemble slightly deformed tori; while the complementary of this regular motion -that 
is, the chaotic motion- has a small Lebesgue measure if e is small. In other words, the set of chaotic trajectories is 
negligible as e — >■ 0. 

In order to be more precise in the formulation of the theorem, one has to assume that H is an analytic function 
and that the unperturbed motion generated by is nondegenerate. The last statement implies that the Hessian of 
Hq is different from zero: 



det 



dJidJj 



^0. 



The next step consists in identifying, for the unperturbed system, a particular torus, To{u)*), defined by a set of 
frequencies, a;* = (wj', . . . , w*), which are incommensurable, that is 

fciWi H h fc„w* 7^ 

for all the integers ki ^ 0. The KAM theorem can then be stated as [Tl 1^1^: 

// eHi is small enough, then for almost all nonresonant frequencies UJ* there exists an invariant surface 
T (uj*) of the perturbed system such that T (u)*) is close to Tq(uj*). 

In other words, the trajectories of the perturbed Hamiltonian will evolve on surfaces T* ~ T (a;*) which are "close to" 
tori To of the integrable system. This means that, for almost all (but not all) nonresonant frequencies, the phase-space 
trajectories are regular and not chaotic as far as e is small enough (the theorem does not tell how small e has to be). 

Moreover, the theorem also proves that the measure of the set of points in phase space which do not lie on any 
surface T* tends to zero when e — ?> 0. That is to say, the probability of randomly choosing initial conditions not 
leading to motion on stable surfaces T* is vanishingly small as e — > 0. This has momentous consequences for the 
stability of planetary orbits because it is extremely unlikely (though not impossible) that a given celestial body is 
located in some unstable (i.e., resonant) region (see, nonetheless, the next section). 

Therefore, we see that, under the conditions of the theorem, small perturbations do not destroy invariant tori Tq 
but only deform them . On these deformed tori, called KAM surfaces, the motion is regular and not chaotic. 

The rigorous proof of the theorem is highly technical and we will not give it here. There are, however, more 
accessible derivations such, for instance, that of R. Barrar [3] to which we refer the interested reader (see also |24|). 
As mentioned above the clue of the proof, discovered by Kolmogorov, is a superconvergent perturbation method 
similar to the old Newton-Raphson technique for solving algebraic equations |25j . 

KAM tori T* are determined by nonresonant frequencies w* and on these deformed tori the motion is not chaotic. 
But, what about resonant tori? What happens to them? In other words, what is the fate, when a perturbation is 
added, of those tori defined by a rational relation of frequencies? It can be shown that resonances completely destroy 
resonant tori [19j. Consequently the trajectories on these tori -which, remember, in the absence of perturbation 
follow well defined closed and periodic curves on them- lose their bounds and wander through the phase space (in 
fact, only through the subspace given by the surface of constant energy). Therefore, motion on resonant tori becomes 
completely irregular and unstable. This is an example of the so-called hard chaos, as opposed to soft-chaos which 
relates to the motion near KAM surfaces [12] (see also next section). 

Fortunately, as KAM theorem proves, the set of resonant tori, on which regular motion is destroyed, has a vanishingly 
small measure as long as the perturbation is small. Equivalently, the remaining slightly deformed tori where the 
motion is still regular, have a measure close to 1 if e is small. This means that most tori are not destroyed for small 
perturbations and KAM surfaces almost densely fill the energy shell and between them there appear "islands" with 
chaotic motion. This results in Poincare sections which are extraordinarily complex and that some authors picture as 
in Fig. |9] 

VIII. MISCELLANEOUS RESULTS 

In this closing section we briefly outline some additional developments and applications of the theory. 

A. Arnold diffusion 



As KAM theorem proves, the energy shell of a conservative and nonintegrable Hamiltonian of the form H = 
Hq + eHi, where Hq is integrable and e is small, is densely filled with KAM surfaces on which phase-space trajectories 
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FIG. 9: Schematic representation of Poincare sections for nonintegrable systems stressing the complex mixture of regular and 
chaotic trajectories. 




are fairly regular. However, outside KAM tori trajectories are random. In order to analyze these chaotic trajectories 
we must distinguish among the cases of two and more than two degrees of freedom. 

Let us recall that, for integrable conservative systems with n degrees of freedom, the phase space is 2n dimensional, 
the energy shell is (2n — 1) dimensional and invariant tori are n dimensional. Hence, for n = 2, the two dimensional 
tori are embedded in the three-dimensional energy surface. This means that any closed surface, such as a torus, divide 
the energy shell into an inner region and an outer region. The same applies to KAM tori of conservative nonintegrable 
system with 2 degrees of freedom. Accordingly, any chaotic trajectory, located in the interspace between two tori, 
cannot escape from it. No matter how complicated its motion is, the trajectory never leaves the region and the action 
variables remain close to their initial values. This is another aspect of the soft-chaos mentioned above, for there exists 
certain stability of motion because KAM surfaces densely populate the energy shell and are, therefore, very close to 
each other. 

However, for n > 3 chaotic trajectories located in regions between tori can escape to other regions of the energy 



shell (see Fig. 10 1. Thus, for instance, if n = 3 the energy shell is 5 dimensional, KAM surfaces 3 dimensional. 



and chaotic trajectories have two additional dimensions to wander through. Hence, for ti > 3 the existence of KAM 
surfaces does not guarantee the stability of motion, as two trajectories which are initially very close to each other 
can be very distant after a finite period of time. This phenomenon, that exists for arbitrarily small perturbations, is 
known as Arnold diffusion and only appears in systems with more than 2 degrees of freedom. 

The set of wandering trajectories resulting from it constitute the so-called Arnold web. There have been several 
attempts to determine the average speed of the spreading of trajectories defined as | AJ/Ai|, where AJ = J(<) — J(0). 
Several theoretical models and numerical studies seem to indicate that this velocity is very small. Some models predict 
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that 



lAJI < 



for 



t < e ^ exp ( e 



-1/2 



which means, that for smaU e, the action at time t, J(i), remains close to its initial value, J(0), for a very long time 
t ~ exp (e~^/^). In other words, the average diffusion velocity is of the order 



AJ 



At 



which is exponentially small and practically undetectable if e ^ 1. 



B. Planetary motion 

Let us return to the problem of the long-time stability of the solar system, one of the major challenges of mechanics 
for more than three centuries. As we know, the solar system is a nonintegrable many-body problem which, to first 
approximation, can be considered conservative. The key point is whether planetary motions are quasiperiodic or 
random. The solar system is too complicated and a direct application of the KAM theorem does not bring practical 
results. On the other hand, planet orbits exhibit great regularity and until recently it was thought that the solar 
system evolves quasiperiodically. In spite of this, there seems to be some evidence that this may not be the case. 

In 1857 the American astronomer D. Kirkwood discovered a series of discontinuities in the distribution of main-belt 
asteroids which circle the Sun and lie between Mars and Jupiter. There are regions where there is a depletion in the 
number of asteroids. These regions are called Kirkwood gaps. One of the most plausible explanation for them has 
been given by S. F. Dermott and C. D. Murray [8_^, who in 1983 proposed that the gaps are due to resonances in the 
three-body problem of the Sun, Jupiter, and the individual asteroids [H1I211. That is, Jupiter perturbs the asteroid's 
almost Keplerian orbit around the Sun and creates resonances in the asteroid's phase space. The location of the 
observed gaps are found to be very close to the resonant surfaces of Jupiter and the asteroids, which would agree with 
KAM theory about the destruction of resonant tori. It has also been argued that the mechanism of Arnold diffusion 
might be responsible for removing asteroids from the gap regions and force some of them to collide with Mars . 

Let us finally mention that there seems to be some numerical evidence that the long-term motion of the former 
planet Pluto is chaotic and also that of some of the main planets of the solar system [53] . All these results seem to 
indicate that the long-time motion of the solar system may be chaotic and, to some extent, unpredictable. 



C. Quantum chaos 



Let us finish this exposition by giving a very brief view on the possible manifestation of chaotic behaviour in 
quantum systems. 

If one naively tries to extend, in a direct manner, the concepts of regular and chaotic trajectories to quantum 
systems, one is immediately faced with an unsurmountable difficulty: due to Heisenberg's uncertainty principle, 
between canonically conjugated variables, it makes no sense to define trajectories in the quantum phase space. 

In fact, the phase space of any system of n degrees of freedom is divided in cells of volume /i" {h is Planck's 
constant) and one cannot determine at which point inside a given cell the system is. This renders the construction of 
phase-space trajectories meaningless. Therefore, the notion of invariant tori, over which the trajectories of integrable 
systems stay, also loses its meaning in the quantum world. 

The problem of the quantization of nonintegrable Hamiltonians can be traced back to the early days of the old 
quantum theory |12| (see [3j for a thorough review). However, strictly speaking, there is no such think as "quantum 
chaos" , although there have been detected some peculiar effects in quantum systems whose classical counterparts cor- 
respond to chaotic systems. Quoting M. Gutzwiller: "the term 'quantum chaos' serves more to describe a conundrum 
than to define a well-posed problem" [Oj . 

What is understood by quantum chaos is essentially the relation between classical chaotic systems and their quantum 
counterparts. Let us recall that in quantum mechanics, the state of the system is not specified by a point (q, p) of 
the phase space but by a wave function ip{ci, t) giving the probability of finding the system at position q in time t. 
However, this wave-like character of quantum systems implies a smooth nature. How can the irregular character of 
classical chaos be reconciled with the smooth and wave-like nature of phenomena on the atomic scale governed by 
quantum mechanics? [13] . What are, therefore, the quantum manifestations of chaos?. 
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There are several places and situations where one can look for the "quantum signatures" of chaos [13] , and substantial 
research has been done along this direction in the last three decades. We can single out one aspect where quantum 
chaos is quite significant. The first place to look is in the energy levels, not a particular level but the distribution of 
them. Thus, and somewhat paradoxically, in nonchaotic quantum systems (i.e., those quantum systems whose classical 
counterparts are integrable) the energy levels are completely random without any correlation, while in chaotic systems 
the energy levels show strong correlations between them, which implies a lower degree of randomness. There are other 
situations in which quantum manifestations of chaos appear as, for example, in the distribution of stationary states 
and in electron scattering, among others. We refer the interested reader to more specialized literature for further 
information (see, for instance, [T2II31IM1)- 



There is a line of thought, among some philosophers and scientists, affirming that science is a construction, being 
scientists designers who fit as many data as possible within consistent frames. Opposite to that, others believe, and 
this is the traditional thinking, that science is discovery and the scientist is like a detective struggling to unveil the 
hidden truth [S] , "the secret of the Old One" , as Einstein put it [7] . Obviously, mainstream scientists lie somewhere 
in between these two extremes. 

Whatever the interpretation one may support, it is beyond any doubt that classical mechanics is one of the finest 
and most creative works that scientific endeavour can yield. In its most sophisticated form, the Hamiltonian approach, 
classical mechanics even arrives to forecast its own limitation: the long-time unpredictable behaviour of nonintegrable 
systems which, as mechanics also proves, are ubiquitous in nature. The solar system, galaxies, galaxy clusters, perhaps 
atoms and beyond, all of them are nonintegrable. 

In this review we have tried to report on this striking consequence of classical mechanics. In a world of uncertainties 
-it all began with quantum mechanics [5]- we can add, as Poincare envisaged, another one: the classical uncertainty. 
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We know that, by definition, a system is integrable when there exist n integrals of motion /^(q, p) = ai that are 
independent and in involution: 



This property allows us to use the Fs as the transformed momenta of some canonical transformation. Indeed, let us 
recall from ^ that any set of n variables p' — {p[, . . . ,p'^) can be considered as the momenta associated to some 
Hamiltonian if — 0. Accordingly, we make the canonical transformation 



in which the integrals of motion are the transformed momenta because the involution property grants it. The 
generating function of this canonical transformation is given by the indefinite integral 
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Appendix A: Integrability and the involution property 



[/„/,]=0. 




(q',p' = a), 




k=l 



where Pfc(q, a) are the momenta written in terms of the coordinates and the constants of motion. 
The equations of the canonical transformation are 



dS , dS 

aq oa 
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and, since we deal with a time independent transformation, the transformed Hamiltonian, H' = _H'(q',a), coincides 
with the original one written in terms of the new coordinates and momenta. 
In the new variables Hamilton equations read 

., dH . dH 

oa aq' 

But a = 0, hence dH/dc( = and H is independent of the coordinates depending only upon the constants of motion: 

H = H{ai, . . . , a„) = E. 

Therefore, from the first group of Hamilton equations, we see that 

., dH{a) , , 

q = — = uia.) = constant 

OCX 

and the equations of motion read 

q'(t) = v{a)t + constant and p'(^) = a. = constant. (Al) 

In this way we have completely integrated Hamilton equations for the motion of the system. Hence, the existence of 
n independent integrals in involution leads to the complete integration of Hamilton equations. 



Appendix B: Periodicity of the angle variables 



The variation, Ai6j, of the angle 9j when the coordinate qi performs a complete oscillation is defined by 

f do 



which, recalling that 9j — dS/dJj (see (19)), we write as 



" [ d^S 9 /" " dS 



But from (18) we have dS/dqk — Pk', hence 



dJ. 



p n 

f y^^Pkdqk 



Using the definition (151 we get 



and, since ( Ji, . . . , J„) are independent variables, we finally obtain 



which is equation (23). 



Appendix C: Commensurable frequencies 



From ( 25 ) we have 
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whence 



and qj(t + Tq) = qj(t) if and only if 



Jk-iiJTo 



1, which imphes 



k • ljTo = 2ttI, 

where I — 0, ±1, ±2, • • • is an arbitrary integer. This condition is equivalent to 

wTo = 27rl, 

where 

1 = {li, . . . , l„) 



(CI) 



(Ij = 0, ±1, ±2, • • •) is an arbitrary integer vector. In effect, if, as (CI I demands, the scalar product of any integer 



vector k with the real vector (l/27r)(x;To has to be an integer number, then necessarily (l/27r)(x;To has to be an integer 
vector. 

Therefore, any coordinate (and the same applies to momenta) will be a periodic function of time, that is to say, 
there will exist a single period Tq for the entire system, if all frequencies lj — (oji, . . . ,a;„) are integer multiples of a 
single frequency loq = 2tt/Tq. That is 



UJ = uiqI, 



(C2) 



which is equation (27) of the main text. 



Appendix D: Canonical perturbations 



In order to prove equation (|43| we have to obtain the transformed Hamiltonian H' under the canonical transfer- 

(Dl) 



mation (39 1. Since we are dealing with a time-independent transformation H' ~ H, and from (37) we write 

H'{e', J') = i/o (J(e)) + eY,H^^\3{e)) cos[k • 0(e)] , 



where J(e) and 0{e) are given (implicitly) in terms of J' and 6' by (41)-(42) 



J(e) = J' + k^k(J') cos [k • 6>(e)] + 0(6^), 



(D2) 



9' = Oie) + e Y: sin [k • 0(e)] + O(e^). 



(D3) 



(D3), that 



We will expand the right hand side of (|D1|) in powers of e. Let us first observe, as trivially seen from (D2) and 

(D4) 



hence 



Therefore, (Dl) reads 



J(e) ^ J' + 0(e), e{e)^e' + 0{e), 



Hl^\3ie))=Hl'\j') + 0ie), cos [k • 0(e)] = cos (k • 0') + 0(e) 



H'{e', J') = Ho (J(e)) + e ^ -ff^'^(J') cos (k • 0') + 0{e^). 



(D5) 
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We next develop the unperturbed Hamiltonian Hq (J(e)) in powers of e up to first order; by Taylor expansion we 
have 



iJo (J(e)) = Ho (J(0)) + e ^Fq (J(e)) 



where J(0) — J' (see (D4)). On the other hand, using the chain rule, we write 



where the dot means the scalar product; but from (D2) we get 

^ = ^ k5k(J') cos [k • e{e)] + 0(e), 



hence. 



de 



Ho (J(e)) 



dHo 



.=0 dJie) 



'=0 



^kS'k(J')cos (k-6>') 



since 0(0) = 0'. 

Recalling that OHq /dJ = are the frequencies of the unperturbed Hamiltonian, we have 



OHq 
d3{e) 



= a;(J(0)) =a;(J'). 



e=0 



Therefore, 



de 



Ho (J(e)) 



e=0 



^k- w(J')S'k(J')cos (k-6>'), 



which substituted into expansion ( D6 1 yields 



Ho (J(e)) = Ho (J') + e ^ k • u;(J')5k(J') cos (k • 0') + ©(e^); 



(D6) 



plugging this expression into ( D5 ) we get 



H'{e',3')^Ho{J')+eY, [^k'^(J')+k-a;(J')^k(J')] cos {k-e) + 0{e^), 

k 

and, removing from the sum the term with /ci = • • • = fc„ = 0, we finally have 

H'{e', J') = Ho{J') + eH^o'\j') + e J2 [^k'^(J') + k • u;(J')^k(J')] cos {k ■ 6) + 0{e^), 



which is equation (43). 
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The same considerations apply to the alternative procedure provided by the Hamilton-Jacobi equation. 
This is the case, within certain approximation, of the Solar System, the Milky Way or even the system Moon-Earth-Sun 
among many others. 

The tori defined in ( 13 1 are often called "invariant tori" because they are constructed by giving different values to the 
integral invariants Ii. 

In the perturbed Kepler problem, as given in (36 1, the term k\u)\ -I- k2UJ2 which appears in the denominator of the 
perturbation series, albeit never zero, can be arbitrarily small for fci and k2 covering all integer numbers except 0. Thus, 
for instance, Jupiter and Saturn, in their motion around the Sun cover 299 and 120, 5 seconds of arc in a day and the 
denominator ^LJSat — 2a;jup is very small compared with each frequency. 
[32] When this occurs the system is termed "ergodic", a key concept in statistical mechanics because it implies that time 
averages are equivalent to phase-space averages. 



